A Multimodal Approach to Communicative Interactivity Classification
نویسندگان
چکیده
The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.
منابع مشابه
ISLE Natural Interactivity and Multimodality Working Group Deliverable D11.2 Requirements Specification for a Tool in Support of Annotation of Natural Interaction and Multimodal Data
for dissemination) This report discusses overall functionality, interface, architecture and platform requirements to a toolset in support of transcription, annotation, information extraction and analysis of natural and multimodal interaction (NIMM) data. NIMM data are corpora of recorded audio and/or visual data from natural and/or multimodal human-human and/or human-system communicative intera...
متن کاملDybkjaer, L., Berman, S., Bernsen, N. O., Carletta, J., Heid, U., & Llisterri, J. (2001). Requirements and specifications for a tool in support of annotation of natural interaction and multimodal data.
for dissemination) This report discusses overall functionality, interface, architecture and platform requirements to a toolset in support of transcription, annotation, information extraction and analysis of natural and multimodal interaction (NIMM) data. NIMM data are corpora of recorded audio and/or visual data from natural and/or multimodal human-human and/or human-system communicative intera...
متن کاملAesthetic Symbolic and Communicative Functions of English Signs in Urban Spaces of Jordan: Typography, Multimodality, and Ideological Values
This study examines the visual aesthetic function of English signs in line with ethnographic approaches as a means of achieving various symbolic and communicative implications in the linguistic landscape (LL) of Jordan. Having coded the data in 6 urban streets of the major Jordanian cities, the social semiotic analysis centers on the visual layout of signs based on the typographical features of...
متن کاملA Multidimensional Approach to Multimodal Dialogue Act Annotation
This paper investigates the benefits of multidimensional approaches to dialogue act annotation, and the advantages of using layered multidimensional ’open’ dialogue act taxonomies. We performed a comparative analysis of a one-dimensional and two multidimensional dialogue act annotation schemes, and concluded that not only does a multidimensional approach support a more accurate analysis of huma...
متن کاملA Multimodal Approach toward Teaching for Transfer: A Case of Team-Teaching in ESAP Writing Courses
This paper presents a detailed examination of learning transfer from an English for Specific Academic Purposes course to authentic discipline-specific writing tasks. To enhance transfer practices, a new approach in planning writing tasks and materials selection was developed. Concerning the conventions of studies in learning transfer that acknowledge different learning preferences, the instruct...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- VLSI Signal Processing
دوره 49 شماره
صفحات -
تاریخ انتشار 2007